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By  Way  of  Introduction 


Cells  in  AI  are  well 
characterized  their  spectro- 
temporal  response  field 
(STRF)... 

STRF(t,x) 

X- 

x=logf/fo 

(octaves) 


o'  t  (ms)  t  \tF{  }\ 


...or  equivalently,  in  the 
Fourier  domain,  by  the  ripple 
transfer  function  (TF). 

irF(w,0)i 


The  STRF  can  be  measured  by  reverse-correlating  with 
the  dynamic  spectrum  of  a  broad-band  stimulus. 

Dynamic  Spectrum  of  Stimulus  Ripple  Spectrum 


S(t,x) 


The  stimuli  should  contain  spectral-peak  densities  and 
modulation  rates  evenly  distributed  over  a  relevant  range. 
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Moving  Ripples 

Moving  ripples  form  our  basis  for  the  Fourier-domain  description  of 
dynamic  spectra.  At  any  time  t  and  any  frequency  x,  their  amplitude  S(tyX)  is 
given  by: _ 

S(tjc)=  sin[27tH'J  +  27t£Xv  +  (|>]  >'■  =  ripple  velocity,  modulation  rate 
x  =  lo g  [/y/0]  £1  =  ripple  frequency,  spectral-peak  density 
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Temporally  Orthogonal  Ripple  Combinations  (TORCs) 

TORCs  are  composed  only  of  ripples  with  different  modulation  rates. 

This  allows  us  to  obtain  clean  STRF  estimates  with  relatively  brief  stimulation. 


250  ms 


The  stimuli  shown  here  contain  ripples 
which  cover  the  same  range  of  ripple 
velocities,  but  at  different  ripple  frequencies. 
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Fully  Separable  STRF 

x  =  log  f/fo 


ITF(w,£l)l 


The  STRF  and  TF  are  a 
product  of  a  single  spectral 
response  function  with  a 
single  temporal  response 
function. 


Shown  above  are  the  impulse  responses  (IR)  and  receptive  fields  (RF) 
derived  from  quadrant  1  (black)  and  quadrant  2  (red)  of  the  transfer 
function  by  inverse  Fourier  transformation. 


Quadrant  Separable  STRF 


X  =  log  f/fo 


w 


The  STRF  is  not  separable, 
but  each  quadrant  of  the 
transfer  function  is,  i.e., 
there  are  different  spectral 
and  temporal  responses  for 
upwards  and  downwards 
This  neuron  responded  twice  as  strong  to  rising  frequency  modulation, 
frequencies  than  it  did  to  falling  frequencies. 
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Singular  Value  Decomposition  (SVD) 

for  Evaluation  of  Separability 
and  for  Noise  Reduction 

If  a  quadrant  of  the  transfer  function  is  separable,  every  row  is  a  scaled 
version  of  every  other  row.  Such  a  matrix  is  said  to  have  a  rank  of  one. 

Singular  Value  Decomposition  (SVD)  can  be  used  to  estimate  the  rank 
of  a  matrix  corrupted  by  noise.  It  decomposes  the  matrix  into  a  sum  of 
rank  one  (separable)  matrices,  ordered  by  their  overall  magnitudes.  The 
first  k  components  sum  to  a  matrix  of  rank  k  which  minimizes  the  power 
of  the  remaining  components. 

We  apply  SVD  to  each  quadrant  of  the  transfer  function. 


Raw  STRF  estimate 
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SVD  naturally  separates  the  signal  and  noise  components  of  a  matrix. 
Typically,  large  jumps  in  the  singular  values  indicate  where  the 
separation  occurs.  Noise  is  removed  by  discarding  the  lower- 
magnitude  components. 
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Below,  STRFs  corresponding  to  the  three  most  significant  quadrant- 
separable  components,  derived  from  SVD,  are  shown. 


Raw  Estimate 


1st  Quadrant-separable 
Component 


2nd 


3rd 
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Without  prior  assumptions,  SVD  indicates  that  a  large  majority  of 
STRFs  in  AI  are  quadrant  separable. 

This  finding  is  further  supported  by  the  similarity  between  the  first 
separable  component  and  the  STRF  measured  with  a  single-ripple 
method,  for  which  quadrant  separability  had  been  assumed. 


1st  Quadrant  Separable 
Component 


Single-Ripple 

Estimate 
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Additional  Examples 
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Predicting  Responses  from  STRF 

The  response  to  an  arbitrary  sound  is  predicted  by  the  convolution  of  the 
STRF  with  the  stimulus’  spectro-temporal  envelope,  plus  a  constant. 


=  X  L  *)  *'  S(f,  X )}  +  E{R(t)\ 
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Stimuli  Used  for  Predictions 
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Validation  by  Prediction 

The  STRF  estimates  often  predict  the  magnitude  and  dynamics 
of  the  response  well. 
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Spike  Rate 


Non-Linearity 

•  The  value  of  the  STRF  at  each  point  (x,  x)  is  the  slope  of  a  linear  rate-level 
function:  R x  x(t )  =[STRF(x,  x)]  •  S(t-z,  x) . 

•  Polynomial  rate-level  curves  are  measured  at  every  (x,  x),  and  improve  the 
description.  These  potentially  non-linear  functions  describe  the  average 
firing  rate  given  the  stimulus  level  around  a  frequency  x  and  at  a  time  xin 
the  past. 


- -  Measured  rate-level  function  at  one  x  and  x 

-  3rd  Order  Regression  Curve 

-  3rd  Order  Regression  with  Inverse-Repeat 

-  Linear  Transfer  Characteristic  given  by  STRF  Estimate 

-  Mean  Spike  Rate 

•  The  power  series  coefficients  of  the  curves  are  given  by  the  diagonals  of  the 
Volterra  kernels,  measured  using  polynomial  correlation. 

•  Using  cubic  polynomials,  we  have  shown  that  either  the  non-linearities  are 
absent,  or  they  are  dominantly  second  order. 


Subtraction  of  the  response  to  the  inverted  envelope  gives  a  nearly  linear 
polynomial  fit.  This  would  be  expected,  for  example,  from  a  rectifying  non¬ 
linearity  (i.e.,  purely  even  order). 
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Spectro-Temporal  Rate-Level  Functions 


Rate-level  functions  change  with  x  and  x. 


Vi 
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Non-linearity  Theory 

The  STRF  is  the  linear  time-invariant  filter  governing  the  transformation 
from  stimulus  to  response.  Thus  it  can  be  identified  with  the  first  kernel 
of  a  Volterra  series  expansion  of  the  system. 


Third-order  Volterra  series  expansion  of  an  input  S(f,  x): 

R(t)  =  v0  + 1 dz^ dx  •  vl(z,x)S(t  -  z,x) 

+| dz1  J  Jt2| dxl  J dx2  •  v2(zl,z2,xl,x2)S(t  -  zvx2)S(t  -  z2,x2) 

+J dzx  J dz2^dz3  J dxx  J dx2  J dx3  •  v3(zl,z2,z3,xl,x2,x3)  • 

S(t-zl,xl)S(t-z2,x2)S(t-z3,x3)  +  ••• 


Form  of  the  Regression  Function: 
(Third-order  Approximation) 

g(s;z,x)  =  F{R(f)  I  S(t  -z,x)  =  s } 

~  a0(z,x)  +  ax(z,x) •  s  +  a2(z,x) •  s 2  +  a3(z,x) •  s3 


•  The  regression  functions  describe  the  non-linearities  within  each 
channel,  but  not  interactions  between  channels. 

The  true  STRF  is  just  the  linear  part... 

STRF(z,  x) = ax  (t,  x) 


Use  of  the  Regression  Function 
to  Predict  the  Response: 

R(t)  =  | dz | dx  •  a0(z,x)  +  J dz J dx  •  ax(z,x)S(t  -  z,x) 

+|  dr  J  dx  •  a2  (t,  x)S2  (t  -  z,  x)  + J  dr  J  dx  •  a3  (z,  x)S 3  ( t  -  z,  x) 
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Summary 

The  Spectro-Temporal  Response  Field  (STRF) 
embodies  the  linear  component  of  a  neuron’s  response  to 
a  sound’s  spectro-temporal  envelope. 

For  neurons  in  Primary  Auditory  Cortex  (AI)  of  Ferrets, 
we  have  previously  characterized  the  STRF  and  its 
Fourier  transform:  the  ripple  transfer  function.  Using 
single  moving  ripples,  we  found  best  responses  to 
temporal  modulations  typically  from  4  to  16  Hz,  and 
spectral-peak  densities  from  0.4  to  1.6  cycles/octave. 

By  reverse-correlating  with  temporally  orthogonal  ripple 
combinations  (TORCs)  enriched  with  these  spectral  and 
temporal  qualities,  we  can  use  brief  stimuli  and  compute 
clean  STRF  estimates  “on  the  fly”. 

Applying  Singular  Value  Decomposition  (SVD)  to  the 
measured  ripple  transfer  functions,  we  found  that  a  vast 
majority  of  STRFs  in  AI  are  quadrant  separable. 
Moreover,  we  were  able  to  isolate  and  discard  much  of 
the  remaining  noise  in  the  STRF  estimate. 

The  measured  STRFs  are  generally  a  good  predictors  of 
the  response  to  broad-band  sounds  with  arbitrary 
spectro-temporal  structure. 

Using  the  same  experimental  paradigm,  rate-level  non- 
linearities  were  measured  at  numerous  frequencies  and 
latencies.  These  were  mild  and  even-ordered, 
corresponding  to  soft-rectification  and  expansion,  and 
they  slightly  improved  response  predictions. 
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